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Abstract 

^ , We propose a method that is able to analyze chaotic time series, gained 

r««». ' from experimental data. The method allows to identify scalar time-delay 

fSJ I systems, ff the dynamics of the system under investigation is governed by a 

^^ . scalar time-delay differential equation of the form ^^^ ' — h{y(t),y{t~To)), the 

^^D ' delay time tq and the function h can be recovered. There are no restrictions 

^^ , to the dimensionality of the chaotic attractor. The method turns out to be 

Q j ■ insensitive to noise. We successfully apply the method to various time series 

taken from a computer experiment and two different electronic oscillators. 
P.A.C.S.: 05.45. -fb 

>.■ 

'^ ■ Time series analysis of chaotic systems has gained much interest in 

Q . recent years. Especially, embedding of time series in a reconstructed 

c^ ! phase space with the help of time-delayed coordinates was widely used 

Q I to estimate fractal dimensions of chaotic attractors |]l|, and Lyapunov 

exponents [Q. It is the advantage of embedding techniques that the 
time series of only one variable has to be analyzed, even if the inves- 
rS [ tigated system is mult i- dimensional. Furthermore, it can be applied, 

d I in principle, to any dynamical system. Unfortunately, the embedding 

techniques only yield information, if the dimensionality of the chaotic 
attractor under investigation is low. Another drawback is the fact that 
it does not give any information about the structure of the dynamical 
system, in the sense, that one is able to identify the underlying insta- 
bilities. In the following, we propose a method which is taylor-suited to 
identify scalar systems with a time-delay induced instability. We will 
show that the differential equation can be recovered from the time se- 
ries, if the investigated dynamics obeys a scalar time-delay differential 
equation. There are no restrictions to the dimensionality of the chaotic 
attractor. Additionally, the method has the advantage to be insensitive 
to noise. 

We consider the time evolution of scalar time-delay differential equa- 
tions 
y{t)= h{y{t),y{t - To)), (1) 
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with the initial condition 

y{t)=yo{t), -ro<i<0. (2) 

The dynamics is supposed to be bounded in the counter-domain V, 
y{t) E'D,W t. In equation (|I]), the time derivative of y{t) does not only 
depend on the state of system at the time t, but there also exist nonlocal 
correlations in time, because the function h additionally depends on the 
time-delayed value y{t — To). These nonlocal correlations in time enable 
scalar time-delay systems to exhibit a complex time evolution. The 
number of positive Lyapunov exponents increases with the delay time 
To . Scalar time-delay systems, therefore, constitute a major class of 
dynamical systems which exhibit hyperchaos 0. In general, though, 
the nonlocal correlations in time are not at all obvious from the time 
series. A state of the system (|l]) is uniquely defined by a function on 
an interval of length tq. Therefore, the phase space of scalar time-delay 
systems must be considered as infinite dimensional. The trajectory in 
the infinite dimensional phase space y(t) = {y(t'),t — tq < t' < t} 
is easily obtained from the time series. The scalar time series y{t), 
therefore, encompasses the complete information about the trajectory 
y{t) in the infinite dimensional phase space. 

The main idea of our analysis method is the following. We project 
the trajectory y{t) from the infinite dimensional phase space to a three- 
dimensional space which is spanned by the coordinates (2/7-0 = y{t — 
To),y = y{t),y = y{t)). In the {yr^,y,y)-spa.ce the differential equation 
([I|) determines a two-dimensional surface h. The projected trajectory 
yroit) = {y(t^'''o)iy{'t),y(t)), therefore, is confined to the surface h and 
is not able to explore other directions of the (j/ro) Vi y)-space. From this, 
we conjecture, that the fractal dimension of the projected attractor has 
to be between one and two. Furthermore, it follows that any inter- 
section of the chaotic attractor with a surface k{yrQ,y,y) = yields a 
curve. More precisely spoken, if one transforms the projected trajec- 
tory ijToit) to a series of points y!^.^ = {y^.^, y\ y^) that fulfill the condition 
k{yl^,y\ ij^) = 0, the series of points {y^^, y\ y^) contract to a curve and 
its dimension has to be less than or equal to one. In general, it cannot 
be expected that one is able to project a chaotic attractor of arbitrary 
dimension to a three-dimensional space, in the way that its projection is 
embedded in a two-dimensional surface. We, nevertheless, demonstrate 
that this is always possible for chaotic attractors of scalar time-delay 
systems (Q). 

In the following, we will show that such finding can be used to reveal 
nonlocal correlations in time from the time series. If the dynamics is 
of the scalar time-delay type (|Ij), the appropriate delay time tq and 
the function h{y,yro) can be recovered . The trajectory in the infinite 
dimensional phase space y{t) is projected to several three-dimensional 
{yr,y,y)-spa.ces upon variation of r. The appropriate value r = Tq is 
just the one for which the projected trajectory y^- lies on a surface. 



representing a fingerprint of the time-delay induced instability. Pro- 
jecting the trajectory yto the (|/roi ?/i j/)-space, the projected trajectory 
yields the surface h{y,yj.Q) in the counter-domain V xT>. With a fit 
procedure the yet unknown function /i(2/,2/to) can be determined in 
V X V. Therefore, the complete scalar time-delay differential equa- 
tion has been recovered from the time series. In some cases, it is more 
convenient to intersect the trajectory ^^ in the (?/^, y, |/)-space with a 
surface k{ii^,y,y) = which yields a series of points y^. = {yl,y\y^). 
For T = tq, the points come to lie on a curve and the fractal dimension 
of the point set has to be less than or equal to one. 

The analysis method is also applicable if noise is added to the time 
series. The only effect of additional noise is that the projected time se- 
ries in the {yro^y, y)-space is not perfectly enclosed in a two-dimensional 
surface, but the surface is somewhat blurred up. If the analysis is done 
with an intersected trajectory, the alignment of the noisy data is not 
perfect. The arguments presented above do not require the dynamics to 
be settled on its chaotic attractor. Therefore, it is also possible to ana- 
lyze transient chaotic dynamics. Recently, the coexistence of attractors 
of time-delay systems has been pointed out . The only requirement 
for the analysis method is that the trajectory obeys the time-evolution 
equation (|1|) which holds for all coexisting attractors in a scalar time- 
delay system. Therefore, the method is applicable, no matter in which 
attractor the dynamics has decided to settle. The analysis requires only 
short time series, which makes it well-suited to be applied on exper- 
imental situations. We successfully apply the method to time series 
gained from a computer experiment and from two different electronic 
oscillators. We show the robustness of the method to additional noise 
by analyzing noisy time series. 

We numerically calculated the time series of the scalar time-delay 
differential equation 



m = f{yj-9{y), (3) 

g(y) = -0.567?/ + 18.172/2 -38.35^^ + 28.56?/^ -6.8?/^ -Co 

with the initial conditon 

y{t)=yo{t), -ro<t<0, (4) 

which is of the form (P with h^yj-g, y) = fijjro) — gijj)- The function g 
has been chosen to be non-invertible in the counter-domain V. The def- 
inition of the functions / and g is ambiguous in the sense that adding 
a constant cq to / can always be cancelled by subtracting cq from g 
without changing h and, therefore, leaving the dynamics of equation 
(j^) unchanged. The control parameter is the delay time Tq. Equation 
d^) is somewhat similar to the Mackey-Glass equation |0], except for 



the function g, which is hnear in the Mackey- Glass system. Part of the 
time series is shown in Fig. 1. We used 500, 000 data points with a time 
step of 0.01 for the analysis. The dimension of the chaotic attractor was 
estimated with the help of the Grassberger-Procaccia algorithm [Q to 
be clearly larger than 5 . To recover the delay time tq and the functions 
/ and g from the time series, we applied the analysis method outlined 
above. We projected the trajectory y{t) from the infinite dimensional 
phase space to several (?/,-, y, 2/)-spaces under variation of r and inter- 
sected the projected trajectory yV with the {y = l.l)-plane, which is 
repeatedly traversed by the trajectory, as can be seen in Fig. 1. The 
results are the times f where the trajectory traverses the {y = 1.1)- 
plane and the intersection points y^. = (?/!^, 1.1, y*). For r being the 
appropriate value tq, the point set y!^^ is correlated via equation (H) 

y' = fiy'J - g{l.l) (5) 

and, therefore, must have a fractal dimension less than or equal to one. 
Then, we ordered the (y*, 2/*)-points with respect to the values of y^. 
A simple measure for the alignment of the points is the length L of a 
polygon line connecting all ordered points (i/^,y*). The length L as a 
function of r is shown in Fig. 2. For r = 0, L(r) is minimal, because 
the points (y^,?/*) are ordered along the diagonal in the (y!^,?/*)-plane. 
L(r) increases with r and eventually reaches a plateau, where the points 
{yl,y'') are maximally uncorrelated. This is due to short-time correla- 
tions of the signal. Eventually, L(r) decreases again and shows a dip 
for T reaching the appropriate value tq. A further decrease of L{t) is 
observed for r = 2tq. In Fig. 3(a)-(c), we show the projections yr(t) of 
the trajectory y{t) from the infinite dimensional phase space to different 
{yr, y, y)-spaces under variation of r. Clearly, for r approaching the ap- 
propriate value To, the appearance of the projected trajectory changes. 
In Fig. 3(c), the projected trajectory is embedded in a surface which 
is determined by the function h. In Fig. 3(d)-(f) we show the point 
set {yl, y*) resulting from the intersection of the projected trajectory yV 
with the {y = l.l)-plane. The point set is projected to the (?/,-, y)-plane. 
According to equation (^), the points are aligned along the function / 
for T = Tq. With the appropriate value Tq, we are in the position to 
recover the functions / and g from the time series. The functions / 
and g are ambiguous with respect to the addition of a constant term 
Co, as has been outlined above. Therefore, one is free to remove the 
ambiguity by invoking an additional condition which we choose to be 

(7(1.1) =0. (6) 

Then, equation (^ reads 

f = Mo)- (7) 

Therefore, function / is recovered by analyzing the intersection points 
y!j.^ in the (y, yT-o)-plane. To recover the function g, we intersected the 



time series with the (1/^-0 = l.l)-plane. The resulting point set y^ = 
{y^,y^) is correlated via 

y^ = fil.l)-giy^). (8) 

The value /(l.l) has been taken from the time series using equation 
(|^). In Fig. 4(a)-(b), we compare the functions / and g, as they have 
been defined in equation @ with the recovery of the functions / and g 
from the time series. We emphasize that no fit parameter is involved. 

We checked the robustness of the method to additional noise by an- 
alyzing noisy time series, which had been produced by adding gaussian 
noise to the time series of equation (^. We analyzed two noisy time 
series with a signal-to-noise ratio (SNR) of 10 and 100. In both cases, 
the additional noise was partially removed with a nearest-neighbor fil- 
ter (for SNR = 100, average over six neighbors; for SNR = 10, average 
over twenty neighbors). After that, the noisy time series were analyzed 
in the same way as has been described above. The inset of Fig. 2 shows 
the result of the analysis. The length L of the polygon line exhibits a 
local minimum for r = tq. In the case of the time series with a SNR of 
10, the local minimum is again sharp, but somewhat less pronounced. 
We conjecture that the method is robust with respect to additional 
noise and, therefore, well suited for the analysis of experimental data. 

Finally, we successfully applied the method to experimental time 
series gained from two different types of electronic oscillators. The 
first one is the Shinriki oscillator |^, ^. The dynamics of the second 
oscillator []TU[ is time-delay induced and mimics the dynamics of the 



Mackey-Glass equation. In both cases, we intersected the trajectory 
with the (y = 0)-plane. The resulting point set was represented in a 
(?/,-, y)-space with different values of r. Then, we ordered the points 
with respect to y^ and the length L of a polygon line connecting all 
ordered points (?/^,?/*) was measured. The results are presented in Fig. 
5 (a) and Fig. 5 (b). In both cases, L{t) has a local minimum for 
small values of r as a result of short-range correlations in time. L{t) 
increases in time and reaches a plateau. For the Shinriki oscillator, no 
further decrease of L{t) is observed for increasing r (Fig. 5(a)). Such 
finding clearly shows that the dynamics of the Shinriki oscillator is not 
time-delay induced. Analyzing the Mackey-Glass oscillator (Fig. 5(b)), 
one finds sharp dips in L{t) for r = tq and r = 2to. This is a direct 
evidence for correlations in time, which are induced by the time delay 
(for details see [0). Obviously, the method is able to identify nonlocal 
correlations in time from the time series. Eventually, the nonlinear 
characteristics of the electronic oscillator is compared to its recovery 
from the time series (Fig. 5 (c)). 

In conclusion, we have presented a method capable to reveal nonlocal 
correlations in time of scalar systems by analyzing the time series. If 
the dynamics of the investigated system is governed by a scalar time- 
delay differential equation, we are able to recover the scalar time-delay 



differential equation. There are no constraints on the dimensionahty of 
the attractor. Since scalar time-delay systems are able to exhibit high- 
dimensional chaos, our method might pave the road to inspect high- 
dimensional chaotic systems, where conventional time-series analysis 
techniques already fail. Furthermore, the motion is not required to be 
settled on its attractor. The method is insensitive against additional 
noise. We have successfully applied the method to time series gained 
from a computer experiment and to experimental data gained from two 
different types of electronic oscillators. 

While, in general, the verification of dynamical models is a highly 
complicated task, we have shown that the identification of scalar time- 
delay systems can be accomplished easily and, thus, allows a detailed 
comparison of the model equation with experimental time series. In sev- 



eral disciplines, e.g., hydrodynamics ||T2[ , chemistry [|^, laser physics 
[|14|, and physiology 0, |15[, time-delay effects have been proposed to 
induce dynamical instabilities. With the help of our method, there is a 
good chance to verify these models by analyzing the experimental time 
series. If the dynamics is indeed governed by a time delay, the delay 
time and the time-evolution equation can be determined. Current and 
future research activities of the authors concentrate on extending the 
time-series analysis method to non-scalar time-delay systems as well as 
to time-delay systems with multiple delay times. 

We thankfully acknowledge valuable discussions with J. Peinke and 
K. Pyragas and financial support of the Deutsche Forschungsgemein- 
schaft. 
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Figure captions 

Fig. 1: Time series of the scalar time-delay system (^ obtained from a 
computer experiment (tq = 40.00). 

Fig. 2: Length L of the polygon line connecting all ordered points of the 
projected point set {yl., ij^) versus r. L has been normalized so that 
a maximally uncorrelated point set has the value L = 1.0. The 
inset shows a close-up of the r-axis around the local minimum at 
T = tq = 40.00. Additionally, L(r)-curves gained from the analysis 
of noisy time series are shown (no additional noise - straight line, 
signal-to-noise ratio of 100 - open circles, and signal-to-noise ratio 
of 10 - squares). 

Fig. 3: (a)-(c): Trajectory yr{t) which has been projected from the infinite 
dimensional phase space to the {yr , y , y)-spa.ce under variation of 
r. (a) r = 20.00. (b) r = 39.60. (c) r = Tq = 40.00. (d)-(f): 
Projected point set y!^ = {yl,y'^) resulting from the intersection 
of the projected trajectory yrit) with the {y = 1.1)- plane under 
variation of r. (d) r = 20.00. (e) r = 39.60. (f) r = tq = 40.00. 

Fig. 4: (a) Comparison of the function / (line) of equation (|^) with its 
recovery from the time series (points), (b) Comparison of the 
function g (line) of equation (^ with its recovery from the time 
series (points). 

Fig. 5: Length L of the polygon line connecting all ordered points of the 
projected point set y^ = {y].,y'^) versus r for (a) the Shinriki and 
(b) the Mackey-Glass oscillator. L{t) has been normalized so 
that it has the value L = 1 for an uncorrelated point set. (c) 
Comparison of the nonlinear characteristics of the Mackey-Glass 
oscillator, which is the function /(?/to) of an ansatz of the form 
h{y,yTo) = fiVro) + 9{y)^ measured directly on the oscillator (line) 
with its recovery from the time series (dots). 
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Bunner et al.: Fig.1 




Burner et al.: Fig. 2 




Bunner et al., Fig. 3 
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